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ABSTRACT 

This document reports on the first year of the STACI 
(Systems Thinking and Curriculum Innovation) project, a two-year 
project which is examining the cognitive demands and consequences of 
using the STELLA (Structural Thinking Experimental Liearning 
Laboratory with Animation) software to teach systems thinkinc;, 
content knowledge, and problem solving. The study is also examining 
the extent to which this approach helps students to acquire 
higher-order thinking skills and generalize their new knowledge and 
skills to other areas. Teachers in physical science, biology, 
chemistry, and social studies at Brattleboro Union High School 
(Vermont) designed and tested ways to use STELLA; traditionally 
taught courses provided control. In addition to time constraints, 
teachers identified five difficult aspects of their task: (1) 
determining the appropriate sequence of knowledge that should be 
followed in teaching systems thinking; (2) identifying the points in 
the curriculum where systems thinking can best be used; (3) 
developing models that illustrate systems thinking but are simple 
enough for students to understand; (4) deciding how and when to 
introduce STELLA; and (5) assessing the effectiveness of systems 
thinking for teaching particular concepts. Teachers made progress in 
curriculum development, and students responded well to the new 
instructional mat'irials. The teacher questionnaire, a class 
assignment, an analysis of time spent on curriculum topics, and a 
reprint of an article on the project are appended. (13 references) 
(Author/MBS) 
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TR87-6. The Systems Thinking and Curriculum Innovation Project: Part I 

The field of systems dynamics focuses on connections among the elements of a 
system and how the elements contribute to the whole. Based on the concept of change, it 
uses simulations - simplified representations of a real-world system - and conq)uter-based 
matfiematical models to represent complex relationdiips among variables in a particular 
environment. In this study researchers examine the cognitive demands and consequences 
of using the systems thinking software STELLA (Structural Thinking Experimental 
Learning Laboratory with Animation) to teach systems thinking, content knowledge, and 
problem solving. The study also examines the extent to which this approach helps studmts 
acquire higher-order thinking skills and generalize their new knowledge and skills to other 
substantive areas. 

In the first year of the project, experimental class teaches in general physical 
science, biology, chemistry, and social studies designed and tested ways to use STELLA 
as they proceedal through their curriculum; traditionally taught courses provided controls. 
Son^ experimental teachers were more successful than others in identifying appropriate 
applications for systems modules. All recognized the delicate balance between using 
traditional methods and infusing systems thinking into their courses. In addition to time 
constraints associated with their noraially heavy teaching responsibilities, they identified 
five difficult aspects of their ta-;!:: (1) determining the appropriate sequence of knowledge 
that should be followed in teaching systems thinking; (2) identifying the points in the 
curriculum where systems thinking can best be used; (3) developing models that illustrate 
systems thinking but arc simple enough for students to understand; (4) deciding how and 
when to introduce STELLA; and (5) assessing the effectiveness of systems thinking as a 
way to teach particular concepts. Despite these dilemmas, teachers made considerable 
progress in curriculum development, and students generally responded well to the new 
instructional materials. Biology most readily lent itself to a systems approach, while the 
general physical science tcachCT and the chemistry teacher found it more difficult to identify 
appropriate topics and devise lessons. In the War and Revolution seminar, offered to 
elected students with advanced knowledge of both systems thinking and STELLA, 
systems thinking was used to study historical events and to develop analytical skills and an 
appreciation of die complexity and importance of policy decisions. 

Using some published instruments and others developed specifically for this 
project, data were collected on student ability and achievement, on cognitive skills thought 
to be related to systems thinking ability, on content learning, and on acquisition of systems 
thinking skills. These data are considcrcd quite prcliminaiy and have been used mainly to 
guide researchers and teachers in adjustments, changes, and revisions for the second, more 
formal year of the project 
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The Systems Thinking and Curriculum Innovation Project 
Technical Report) Part 1 

General Background Information 

The intent of the Systems Thinking and Curriculum Innovation 
(STACI) Project is to examine the cognitive demands and 
consequences of learning from a systems thinking approach to 
instruction and from using simulation modeling software. The 
purpose of the study is to test the potentials and effects of using 
the systems thinking approach in existing secondary school 
curricula to teach content-specific knowledge as well as general 
problem solving skills. The study also examines the effectiveness 
of using STELLA (Structural Thinking Experimental Learning 
Laboratory with Animation; Richmond^ 1985; Richmond & VescusO) 
1986) 9 a software package for the Macintosh'^'^ microcomputer) as a 
tool with which to teach systems thinking* content knowledge* and 
problem solving. The research focuses on (a) the learning outcomes 
and transfer that result from using such an approach and software 
in classroom settings, and (b) the ort,anizational impact of the 
curriculum innovation. 

The study is being conducted at Brattleboro Union High School 
(BUHS), Brattleboro* Vermont in which four teachers are using 
systems thinking in their courses. The content areas include 
general physical science* biology* chemistry* and an experimental 
social studies course entitled War and Revolution. These four 
teachers were trained to use STELLA and system dynamics (Mandinach 
& Thorpe* 1987b >. They are using systems models and illustrating 
them on the computer. Students examine the interrelationships 
among variables and system properties through their interactions 
with the simulation modeling software. The STELLA software enables 
students to model the characteristics and interrelationships of 
complex system? in the real world* and to follow the evolution of 
these models over time. 

The purpose of the project is to examine the extent to which 
students acquire higher-order cognitive skills through exposure to 
and interaction with a curriculum infused with systems thinking 
and subsequently generalize knowledge and skills to problem solving 
tasks in other substantive areas. Comparisons are being drawn 
between traditionally taught courses and those that use the systems 
approach and STELLA. The research enables the examination of skill 
and knowledge transfer across content areas as students are exposed 
to several courses that use the systems approach. 

Two ancillary studies are being conducted in conjunction with 
the main classroom study. The first substudy focused on a select 
group of students who received extensive exposure to systems 
thinking and STELLA in a social studies class on War and 
Revolutions. These students were studied in an intensive case 
study format. The objective of this study was to collect indepth 
information about the students' thought processes* performance 
patterns* knowledge* and general problem solving skills. 
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The second substudy is examining the organizational impact of 
the introduction and implementation of systems thinking in the high 
school. The objective is to analyze changes that occur in the 
structure and functioning of the school as a result of the 
curriculum innovation. These changes will be documented and 
analyzed to shed light on educational organizations. 

The STACI Project, which began during the 1986-1987 academic 
year, is a two-year research effort that is concluding its first 
year. The purpose of this document is to report on the project's 
work conducted during Year 1. The report is based on six site 
visits, correspondence, frequent telephone conversations) and 
several presentations to professional audiences. We provide 
descriptions of systems thinking, the site, the design, data 
collection, instrumentation, the ancillary studies, and curriculum 
development. A forthcoming report will document the cognitive test 
results from the main classroom study and the War and 

Revolution substudy. 

Systems Thinking 

The field of system dynamics, based on the concept of change, 
uses simulations and computer-based mathematical models to 
represent complex relationships among variables in the environment 
(Forrester, 1968). It is possible to explore the rule-governed 
behavior of complex systems by constructing models of variables and 
their interactions, and examining the cause-and-ef feet 
relationships among the variables. Simulation models are used to 
examine the structure of such systems. A simulation generally is a 
simplified representation of the real-world system. 

To build a simulation, it is necessary to understand the major 
variables that comprise the system. These variables can be used to 
form a dynamic feedback system, whose mathematical expression is a 
set of simultaneous equations* Over time, variables change and 
subsequently cause other variables and their interactions t.i change 
as well. Thus, system dynamics focuses on the connections among 
the elements of the system and how the elements contribute to the 
whole (Roberts, Andersen, Deal? Garet, & Shaffer, 1983). 

The concepts that underlie the field of system dynamics form 
the basis for much of the simulation software that currently is 
used in educational settings. Until recently, the system dynamics 
approach to simulations was constrained to environments that had 
powerful mainframe computers (i.e.. Dynamo and Micro-dynamo). The 
advent of a new software product has made it possible to translate 
these concepts to the microcomputer level. The software, STELLA, 
capitalizes on the graphical capabilities of the Apple Macintosh^*^ 
and enables learners to build systems models using icons and mouse 
technology. STELLA makes systems modeling approachable to the 
novice by minimizing the mathematical and technical skills needed 
to construct models* The user supplies the logic and knowledge of 
a domain necessary to build the model, and STELLA creates the 
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structural diagrams^ graphs^ and data that represent the system. 
Thus, STELLA is a powerful software tool that enables students to 
build models and simulations within the context of a systems 
thinking approach to learning. 

Site Description; Brattleboro Union High School 

BUMS serves a rural five-town district in southeastern Vermont 
whose population is approximately 20,000. The school has roughly 
1,600 students and a faculty of 80 teachers. 

Since 1985, BUMS has been the site of a number of systems 
thinking activities, all with the purpose of introducing students, 
educators, and the public to the principles that underlie the 
field. Two informational workshops were an outgrowth of an initial 
collaborative group that was formed to support systems thinking 
activities. The first workshop was a one-day seminar given in the 
spring of 1985 by experts from the Massachusetts Institute of 
Technology (MIT). The intent of the meeting was to provide 
sufficient knowledge of system dynamics to high school teachers so 
that the concepts could be integrated into their courses. The 
second workshop was an intensive five-day introduction to systems 
thinking. Taught by representatives of MIT and Dartmouth, this 
seminar was attended by BUMS teachers, students, parents, school 
board m&mbers, and individuals from local business. 

Four teacriers comprised the core of the systems group at BUMS. 
All were trained by experts to use the systems approach and 
integrated this perspective into their courses. One course, 
entitled War and Revolution, was heavily infused with systems 
thinking and the use of STELLA. That is, systems thinking formed 
the basis for this course. In contrast, an integrative approach 
was used in the science courses. The approach was integrative in 
that the teachers identified concepts within their curricula that 
could be enhanced by the use of systems thinking principles. 
Rather than teach the particular concepts as they had in the past, 
the systems teachers explicitly emphasized the systemic nature of 
the topics, noting such ideas as causality, feedback, variation, 
and interaction. The courses covered the same body of knowledge 
taught in the traditional curriculum, but specific concepts and 
topics were discussed from a systems thinking perspective. These 
courses will be described in greater detail in the curriculum 
section. The BUMS teachers next plan to develop for the 
forthcoming academic year a new course entitled Science, 
Technology, and Society that will incorporate an extensive 
introduction to system dynamics and STELLA. 

Design and Data Collection 

Design 

Systems thinking was integrated into three general physical 
science, four biology, and three chemistry classes. An equivalent 
numbc!r of traditional (control) courses were taught concurrently by 
O 3 

ERLC 8 



Systems Thinking 



other members of the faculty. Table 1 presents the enrollment 
figures for the classes participating in the study. 

As noted in the first STACI progress report (Mandinach & 
Thorpe, 1987), obtaining parental consent was problematic. ETS and 
the eight BUMS teachers made every effort to gain permission for 
students' participation. We were able to obtain consent for 353 
of the ^12 students (or 86%). Consent was withheld for 
approximately UX of the students. The figures differed across 
classes and subject areas, with nearly all chemistry students (9^*/.) 
willing to participate. Biology, across the three teachers, had 
the lowest consent rate (77*/.). The consent rate for general 
physical science was 87*/.. The percents of consent for the systems 
(85%) and traditional (86%) groups were roughly equal. 



Table 1 

Classes and Enrollment Figures - 1986-1987 



Class Systems Thinkina 


Traditional 


Classes 


Students 


Classes 


Students 


General Physical Science 3 


^O(li) 


3 


57( 3) 


Biology 








Teacher 1 ^ 


68(16) 


2 


32(12) 


Teacher 2 




2 


29(10) 




68(16) 




61(22) 


Chemistry 3 


57( 3) 


3 


63( ^) 


TOTAL 10 


165(30) 


10 


181(29) 


War and Revolution 1 


7( 0) 






Note: The numbers in pareiitheses 


indicate the 


students 


for whom 



parental consent was either denied or could not be obtained. 

Data Collection! Instrumentation 

As noted in the ETS proposal (Mandinach, 1986), several types 
of instruments were used to assess outcomes in various stages of 
the research. These instruments included pretest* in-class, and 
posttest measures) which were used to assess ability, content- 
specific knowledge, systems thinking, and higher-order thinking 
skills (including general problem solving, metacognition, and self- 
regulation) . 

Pretests were used to assess subjects* abilityj content- 
specific knowledge, and knowledge of systems thinking. Existing 
instruments were used or modified) and other tests developed where 
needed. BUMS supplied the students' most recent standardized 
achievement test scores. The California Achievement Tests served 
as rough estimates of general ability. ETS also administered a 
small battery of tests, incluH^ng the Advanced Progressive Matrices 
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(Raven? 1958, 1962) » to provide anochsr index of general ability. 
Other measures related to skills hypothesized as important concepts 
underlying systems thinking were given. These included inductive 
and deductive reasoning, figural analogies} and understanding 
relationships. 

Modified versions of previous final examinations were 
administered to both the systems and traditional classes. The 
general physical science, biology, and chemistry teachers took last 
year's tests, identified critical, yet basic concepts, and gave the 
shortened versions to their classes early in the academic year. 
These tests served as baseline assessments of content knowledge in 
the subject areas. An initial assessment of systems thinking 
skills, developed by TERC, containing itemS) also was 
administered early in the semester to serve as a baseline for the 
experimental classes. 

Teachers administered content-specific tests and exercises in 
their courses throughout the academic year. These examinations and 
exercises were roughly comparable for the systems and control 
classes in their subject-matter coverage. The teachers also 
prepared and gave common final examinations to their classes. 
Because traditional and systems thinking classes within a subject 
area received the hame test, we were able to compare differences in 
content knowledge that resulted from using the systems approach. 
These measures of content knowledge were not used to assess pre- 
and posttest differences. Instead, they were used to provide 
information about the evolution of differential performance over 
time between the two sets of classes. 

ETS developed a 39-item instrument that was used to assess 
knowledge of systems thinking and STELLA. The instrument contained 
items of increasing difficulty that measured a broad spectrum of 
skills along a continuum ranging from elementary concepts to 
complex modeling skills. These skills were identified in 
consultation with the BUHS teachers and systems experts and through 
rational task analyses as critical components that underlie systems 
thinking. Measures of systems thinking focused on concepts such as 
knowledge of graphing^ equations, variation and variables, 
causation and causality, feedback) looping constructs, modeling, 
and STELLA. This test was administered at the end of the year to 
only the systems thinking classes. 

It should be noted that instrument development is critical to 
the STALI project. Much of the project's success rests on the 
as:^umption that reliable and valid measures, particularly of 
systems thinking, can be designed. These measures must capture 
both qualitatively and quantitatively students' performance^ 
ciderstanding, and cognitive processing. Reliabilities for each of 
the instruments will be calculated. We will examine the systems 
thinking test's internal consistency, using the Cronbach alpha 
coefficient and will perform split-half reliabilities on the 
measures in the reference battery. 




STAC I Year 1 Report 



Given the exploratory nature of the first year, we developed 
and administered the instruments on a preliminary basis and plan to 
revise them as indicated by the results. Our primary focus will be 
on the required revisions to the systems thinking test. 
Examination of the reliability results, in addition to a factor 
analysis, will provide an indication of the consistency and 
performance of the instrument in assessing skills thought to be 
critical in system^- thinking. Furthermore, we will examine item- 
level data by class to identify the appropriate level of difficulty 
for each course. Initial results indicate overlapping, but 
progressively more difficult ranges of performance in moving from 
general physical science, to biology and then chemistry. 
The data analyses currently are being conducted. Revisions will be 
made accordingly. The results will be reported in the subsequent 
document that will focus on the quantitative analyses. 

Data Collection; Observations and Interviews 

Classroom observations were conducted during six site visits 
throughout the school year. Two project members observed both 
systems and traditional classes to obtain information about course 
content, structure, and classroom procedures. Systems classes were 
observed when systems modules as well as traditional materials were 
presented. Observations were scheduled when similar topics were 
covered to see how the systems and traditional teachers differed in 
their approach to the highlighted concepts. For example, we 
observed how the chemistry teachers presented the topic of reaction 
rates, noting differences in emphases, presentation, and other 
areas due to the use of systems concepts. 

Interviews with systems and traditional teachers were 
conducted to obtain additional information about the classes (see 
Appendix A). It ¥tr^s critical to gather information from the 
systems teachers concerning the issues they confronted during the 
implementation of the curriculum innovation. The interviews also 
provided an opportunity to probe teachers about their perceptions 
of the systems thinking modules, implementation difficulties, and 
other issues related to the effects of the curriculum innovation on 
their teaching activities. 

To examine variation in content emphasis, all science teachers 
were asked to provide information on the number of days devoted to 
different curriculum topics. The systems teachers also were asked 
to indicate the time devoted to instruction in systems thinking and 
to which topics the approach was applied. 



The Uar and Revolution Seminar 

The course. The War and Revolution seminar provided a unique 
approach and structure to the examination of historical events. 
The course was conceived by the teacher amJ David Kreutzer, of the 
System Dynamics Group at MIT, as a means of applying systems 
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thinking to an understanding of political-social events, ^he 
unique aspect of this course was the prominent role given to 
systems thinking in the study of historical events. The course was 
offered for the first time to a group of seven academically 
talented students* three of whom were National Merit Scholars. 
Among these students were two seniors who received outside training 
in systems thinking and STELLA. These two students previously 
developed causal loop diagrams and structural models related to 
other topics. They also assisted their classmates in learning how 
to develop models and use STELLA. 

The class functioned much like a college seminar. Students 
met together as a class three times per week with the remaining two 
periods spenr working individually or cooperatively in small 
groups. Through class discussions and independent research 
projects, students analyzed dynamic situations from the perspective 
of decision makers. The intent was to develop both analytical 
skills and an appreciation of the complexities and importance of 
policy decisions. Through the course students developed abilities 
to pose questions* gather relevant information from a variety of 
sources* develop scenarios depicting relationships among kev 
forces* and critique as well as defend these views. 

The primary text* Thinking in Time (Neustadt & May* 1986) was 
supplemented with other sources that pertained to topics for group 
discussion and students' independent research interests. Students 
were expected to read major newspapers including the New York Times 
and news magazines. They also were encouraged to broaden their 
sources of information to include professional journals* books* 
government documents* and other media. 

The teacher used various revolutions (e.g.* the 1956 Hungarian 
Revolution* the Iranian Revolution* and the Revolution in 
Nicaragua)* as well as Kreutzer's model of terrorism* to introduce 
students to systems thinking as a strategy for analyzing the 
dynamics of historical and current events. They studied basic 
concepts for modeling systems* reviewed some existing models and 
experimented with constructing models of their own. Kreutzer 
conducted several seminars for the class to discuss the logic 
underlying model development* reinforce fundamental systems 
concepts* address ^specific questions* and assist students with 
their special projects. He provided consultation throughout the 
year as students developed their own models. 

The study. The ancille^ry study focused on a limited number of 
students who exhibited particularly advanced knowledge of systems 
thinking and skills in using STELLA. The purpose of this substudy 
was to collect indepth information about the thought processes* 
performance patterns* knowledge* and general problem solving skills 
of experienced students who were exposed to a seminar fully infused 
with systems thinking and the simulation modeling software. 

Students were introduced to systems thinking as a strategy for 
analyzing the dynamics of historical and current events. They 
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studied basic concepts for modeling systemst revieKed s:ome existing 

models and experimented with constructing models of their c The 

students prepared final versions of their models of revolution 
during the lest quarter of the ye^r. Each student prepared a 
systems model to illustrate the dynamic factors underlying their 
particular topiC) presented a formal report and STELLA nodel) and 
made a presentation to the class describing the model. In 
addition, the teacher request:ed th^*; the students include in their 
reports a discussion of the effects systems thinking had on their 
work and perspf^ctive of the subject area. 

In Year l, the seven students enrolled in the War and 
Revolution class received extensive exposure to systems thinking 
and us .'d STELLA for innovative applications of modeling. These 
students were studied in an intensive case study format throughout 
the academic year, culminating in a special project conducted 
during the last month of school ETS observed their performance in 
the seminar and with STELLA (observations of approximately SO class 
periods), assessed their knowledge, collected verbal protocols, 
conducted interviews, and examined their major projects completed 
for the course. The interviews and verbal protocols elicited 
detailed information about how students approached, analyzed, and 
work through problems assigned in the course. 

The special projeCw for thr War and Revolution class was 
conducted at BUHS during the weeks of May 18 and SS. The problem 
used was the Zimbardo Prison Experiment. This experiment created a 
simulated prison environment in which college students portrayed 
inmates and guards (see Appendix B for additional information). 
Initial reading materials were sent to the students, followed by a 
slide/sound presentation of the problem. Stude^^s were given a 
week in which to develop and prepare systems and STELLA models of 
the experiment. Kreutzer provided facilitation during the 
administration of the project. At the end of the week, each 
student handed in a brief report, triffir causal models, and a disk 
on which their STELLA models were saved. Analyses of the models 
and accompanying materials currently are being conducted. 

Organ i zational Case Study 

Interviews were used to trace the organizational impact of the 
introduction and implementation of systems thinking at BUHS. 
Whenever new technologies and expertise are introduced in schools, 
changes c>^cur in organizational structure, division of labor, 
communicaicion patterns, and distribution of authority and 
influence. These changes are being documented and analyzed to shed 
light on the impact of technology on the structure ar^ functioning 
of educational organizations. 

Initial data collection for the ancillary study was conducted 
in the April and May site visits. During both visits, interviews 
were conducted with a number of individuals at Brat^leboro who had 
varying ^es of involvement in the STACI Project. Interviews 
includeo ;he systems thinking teachers, the science and social 



ERIC 




STACI Year 1 Report 



studies departmental chairpersons^ the principal » superintendents 
the head of guidance* and other BUMS teachers. Follow-up and 
additional interviews will continue throughout the next academic 
year. These data then will be synthesized in the form of a case 
study that depicts how systems thinking evolved at BUMS and wha 
its impact has been on the school as an organization. The case 
study will be reported at the conclusion of Year S in order to 
examine the innovation's impact as it evolves over the course of 
the project. 



This section describes the 1986-1987 curriculum for the 
traditional and systems thinking science classes. We begin with 
several observations about the curriculum in general. Summaries of 
both subject and systems thinking content are provided. 
Information cbout thr curriculum content was obtained through 
interviews with teachers* brief questionnaires* textbook reviews* 
and classroom observations. 

General Observations 

Curriculum development in systems thinking has been a labor- 
intensive and ongoing effort. ETS recognizes that during this 
first year as systems thinking was introduced* instructional 
methods and course content underwent a great deal of 
experimentation. Some teachers were more successful than others in 
identifying appropriate applications for systems modules. All the 
teachers were acutely aware of the delicate balance between using 
traditional methods and infusing systems thinking into their 
courses. 

Though the teachers were intrigued by the possibilities 
offered by systems thinking and STELLA* they grappled with the 
realities of developing an innovative curricular approach while 
maintaining heavy teaching responsibilities. One of the most 
difficult realities was the time required to develop expertise in 
systems thinking and then integrate the concepts into their 
existing curricula. Other issues included: (a) the appropriate 
sequence of knowledge that should be followed in teaching systems 
thinking; (b> the points in the curriculum where systems thinking 
can best be used; (c) the development of examples that illustrate 
important variables and relationships* but are simple enough for 
students to understand; (d) the introduction of STELLA; and (e) the 
effectiveness of systems thinking as a way to teach particular 
concepts. (Is systems thinking worth the tradeoff in time that 
could be spent teaching the subject matter in more traditional 
ways? ) 

Both the systems and traditional classes used the same texts 
in their classes as primary components of the curricula. Common 
final examinations also were administered to all classes within a 
given subject area. Despite these commonalities^ the teachers 
differed in their content emphases* assignments* classroom 
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organization* and instructional styles. These differences and the 
potential impact they may have on learning processes and outcomes 
were examined through observation^ interview^ and performance 
measures during the project's first year. 

Curriculum development and implementation also were affected 
by the availability of hardware and software for project use. 
Apple Computer) Inc. donated fifteen Macintosh^*^ computers to BUHS 
through the Educational Technology Center for project use. A 
classroom set of STELLA software was obtained) in addition to a 
Limelight projection system. These acquisitions enabled BUHS to 
set up a computer classroom which wa& devoted to the STACI project. 
This room did not materialize as early as anticipated due to delays 
in the construction of a new science wing. It was not until March 
that the teachers moved into their new facilities^ thereby making 
available the room in which the computer laboratory now is located. 
This delay hindered not only the introduction of systems thinking 
and STELLA) but also affected science instruction more generally. 

In the coming year) the data collection procedures) 
implemented on a trial basiS) will be revised in order to maximize 
the informativeness of the data gathered. We will collaborate with 
the teachers to develop efficient and complete data collection 
procedures. Because teachers were in the process of developing 
their curricula over the course of the year) it was somewhat 
difficult to schedule observations to collect the information 
relating specifically to the understanding of content or the 
effects of systems thinking. The teachers were often unable to 
specify in advance either the topics or dates when systems lessons 
would be taught. Due to differences in curriculum integration) the 
three science teachers did not conduct their systems lessons at the 
same time. As a result of these contraints and the distan're 
between ETS and Brattleboro (approximately 300 miles)) it was not 
possible to observe all instances of systems instruction. While 
teachers' noteS) handoutS) and exercises were extremely helpful in 
reporting about many aspects of systems instruction) it was not 
always possible to obtain data sufficient for a complete 
understanding of the curriculum innovation. Discussions with the 
systems teachers will be held early in the fall to consult about 
data collection requirements for Year 2. 

In Year 1) although we collected information from the systems 
teachers on student assignments related to systems thinking) we did 
not request classroom assignments on these same science topics from 
the control teachers. The decision to forego this information 
during this initial year was made to reduce the response burden of 
the traditional teachers. During the coming year we will seek 
classroom assignments from the traditional teachers for selected 
topics taught from a systems perspective. 

General Physical Science 

Subject content . General physical science is an introductory 
course for freshmen and sophomores consisting of one semester of 
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chemistry and another of physics. Because of the temporary 
shortage of laboratory facilities this year (i.e.» the construction 
of the new science wing)» the systems and traditional teachers 
taught the course in reverse sequence. Chemistry was taught to the 
control classes during the first semest3r» followed by physics 
in the spring. The systems classes began the year with physics and 
studied chemistry in the second semester. 

The course covered topics related to matter and energy. The 
purpose of the course was to introduce students to concepts in 
chemistry and ph/sics as they apply in everyday life. Students 
learned the basic principles of measurements concepts of work» 
&nergy» and motion. Chemistry concepts were introduced through the 
srudy of atomic structure* properties of elements^ and chemical 
reactions. Physics concepts were covered through the topics 
of light » sounds heat» electric ity» and nuclear energy. 

Although both teachers used Focus on Physical Science (Heimler 
& Price» 198^) » there were considerable differences in how textual 
and other supplementary materials were assigned (see Appendix C). 
The systems tescher spent more time on physics concepts and less on 
chemistry* whereas the reverse was true for the traditional 
teacher. (This was in part due to when the laboratory facilities 
became available.) The systems teacher supplemented the text with 
other material in addition to the systems lessons* whereas the 
traditional teacher followed the text more closely. Comparisons o^ 
students' understanding of particular science topics taught through 
a traditional versus a systems thinking perspective will take into 
account differences in exposure to topics as well as differences in 
instructional methods and materials. 

Systems content . The general physical science teacher 
introduced systems thinking more slowly into his course than did 
the other systems teachers. He initially cited some difficulty in 
determining how to integrate the approach into his lessons and 
devising appropriate examples that students could understand. The 
mathematical nature of physics led him to begin with graphing 
cause-and-effect relationship^! and translating that information 
into simple arrow diagrams. This approach was used in a variety of 
topics over the course of the year* including discussions of 
motion* electricity* magnetism* light and sound waves* color* 
density* and compound formation. The teacher noted that though 
the approach was used for several topics* each discission was very 
brief* averaging approximately 10 minutes. 

Unlike the systems teachers in biology and chemistry* more 
complex causal loop structures were not developed in general 
physical science. The teacher reported that GPS curricular topics 
did not lend themselves to simple feedback relationships. Feedback 
was discussed briefly at the beginning of the year and again at the 
end during the introduction to STELLA modeling. However* the 
teacher reported that time constraints limited the discussion. 
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Models were introduced at the beginning of school and 
continued to be a major topic of discussion throughout the year. 
One week was spent on the general concept of models which included 
the "Modeling" video tape in the "Search for Solutions" series. 
The atomic model) used as an explanation for static electrical 
effectsj was the first physical science model to which several 
class periods were devoted. Models also uere used in explaining 
electrical circuits as well as the distinctions and relationships 
among potential) current) and resistance. A wave model was 
constructed to help students understand the behavior of light. 
While students were interested initially in the demonstrations and 
investigations) the teacher reported that several students had 
difficulty synthesizing the information and extrapolating the light 
wave model to analogous physical phenomena. The atomic model was 
revisited briefly later in the year to help explain chemical 
bonding and compound formation. 

Simple mathematical modeling was introduced early in the year. 
Graphs were developed to illustrate relationships among distance^ 
speed) and time. Mathematical modeling also was used to understand 
the concept of density as a function of mass divided by volume. 

At the end of the year STELLA was introduced with the motion 
detectors developed at the Technical Education Research Centers 
(TERO) in Cambridge. A bathtub model was constructed to study the 
inflow and outflow of wati^r. The teacher noted that the week 
allotted to the presentation was insufficient. Only one day could 
be devoted to introducing stocks and flows prior to demonstrating a 
simple STELLA model of a bathtub filling with water. Students were 
able to spend only a short time learning to use the Macintosh^^ 
then exploring the bathtub model themselves on the computer. 
Difficulties with the equipment) notably the projection system and 
the probes prevented the most effective use of the limited time 
available. 

aioloQv 

Subject content . The systems and traditional teachers 
indicated that the content for all biology classes was similar. 
Though there was some variation in tha selection and emphasis of 
certain topics (see Appendix C), all classes used Bioloavr Living 
Systems (Oram) Hummer) & Smoot) 1986) and followed the same 
sequence with approximately the same scheduling of topics. 

The curriculum presented information about how living 
organisms are structured) function) and the processes by which they 
relate to other organisms and the environment. The text is 
organized around the theme that all living organisms share common 
life processes. The goal of the course was to develop an 
understanding of these basic processes and how they are expressed 
in a diversity of life forms. 

To develop this understanding) the course began with an 
overview of the basic processes of food production and energy 
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transfer* growth and development » maintenance and repair » and 
reproduction. The concepts of organization and interrelationship 
among living organisms also were introduced. Methods and measures 
of scientific inquiry were presented* followed by the general 
principles of chemistry and cellular biology necessary to 
comprehend physiological processes. A discussion of genetics 
covered the cellular basis of heredity » reproduction* and 
variation. The course also included the topics of evolution and 
adaptations that promote survival and reproduction. As the course 
proceeded* the five kingdoms were presented and described in terms 
of the life processes of their members* ranging in complexity from 
the simplest to the most intricate organisms. 

Systems content . The science teachers agreed that biological 
science* of all the subject areas* lent itself most readily to a 
systems approach. Because interrelationships among living systems 
is a key concept stressed in this course* 'whe potential is present 
for identifying a number of relevant examples to which systems 
thinking can be applied. 

Systems thinking was introduced in biology* beginning with 
definitions and fundamental principles such as a system* components 
of a system* feedback* and causal relationships. The "Modeling" 
video also was shown to the biology classes. Following the 
introduction of ter^iis and concepts* students were shown examples of 
causal loops. Initially* single loops were introduced* followed by 
examples illustrating complex loops. These ideas were presented 
using both biological and non-biological examples. Biological 
models included the fight/flight response of the cell during 
insulin reaction as well as models for cellular respiration, 
photosynthesis* and decomposition. Non-biological illustrations 
were drawn primarily from Introduction to Computer Simulation; A 
Systems Dynamics Modeling Approach (Roberts* et al.* 1983). These 
latter models included examples of traffic dynamics and the 
spending* earnings* and savings model. 

In assessing students* reactions to systems thinking* the 
teacher indicated that students appeared initially interested in 
learning the concepts and discussing simple causal diagrams. 
Difficulties arose as complexity was introduced. Not all students 
were able to follow the connections between loops. As other 
examples from the Robert's et al. book were introduced* including 
the development of a forest <which contains four loops and the 
carbon cycle which contains more than eight loops)* the teacher 
found it helpful to discuss one loop at a time and give students a 
rule to guide their pathway through the system ("take the shortest 
route back to where you started"). 

After a few weeks* the teacher reintroduced causal loops using 
a model for the role of enzymes in metabolism. In presenting this 
example* the teacher displayed the prepared model and used a 
problem solving approach to interpret the process depicted. Using 
the analogy of a puzzle* the concept of structure* coupled with 
function was illustrated. Students were asked what would happen if 
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one piece of the puzzle was changed. In this instance, systems 
T;hinking was employed to help students understand the process of 
metabolism and the idea of the relatedness among cell structures. 
Students then were given homework assignments to describe the 
metabolism diagram discussed in class and the process of how three 
cell structures were related. 

The concepts of levels and rates were taught early in the 
second term in conjunction with a brief exposure to graphing. The 
concept of modeling was presented as an introduction to STELLA and 
the population model. Analogies were drawn to familiar scientific 
topicSf including mitosis and meiosis, that students had just 
reviewed. The teacher reported that students were responsive to 
these discussions and demonstrations^ but that time did not permit 
hands-on experience with STELLA. 

After an interim of three months^ students again were 
introduced to computer modeling in conjunction with laboratory work 
on temperature changes. Using ^he projection system^ the teacher 
presented a model for "cooling soup" constructed on the computer. 
Students recorded temperature changes and constructed their own 
paper-and-pencil graphs as the soup cooled. The teacher modeled 
the temperature changes using STELLA. This experience provided 
students with an opportunity to see the effects dynamically 
portrayed in the STELLA model and compare their results with those 
displayed by STELLA. 

A model of oxygen production was presented using STELLA prior 
to conducting a laboratory experiment on photosynthetic rate. 
Students then were asked to posit hypotheses to predict the 
relationship between li^fht intensity and oxygen production. 
Through guided discussion) students also wer^ asked to identify 
elements to construct a structural model by suggesting stocks? 
flowS) and the factors that might affect the relationship. The 
teacher indicated that some students did not appear to understand 
the relationships depicted in the model. However, following a 
subsequent laboratory experiments students were able to recognize 
the relationship between light intensity and photosynthetic rate. 

Near the end of the school years students were given a chance 
to use the computers to work on a model of oxygen production. 
Reactions to these experiences generally were positive, but many 
students indicated that more time was needed to become familiar 
with the computers and the model. The teacher also indicated that 
more hands-on time with the computers and STELLA was needed to 
assess the learning potential of this experience. 

Chemistry 

Subject content . All classes used Chemistry : A Modern Course 
<Smoot, Price) & Smith) 1979) with the same sequence and 
approximately the same scheduling of topics. The central theme of 
the course was that the characteristics of matter are dependent on 
their structure. A primary objective was to develop an 
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understanding of the properties of matter and the relationship of 
structure to properties- In addition to principles of structure, 
the course introduced matter-energy relationships, the concepts of 
moles, thermodynamics, and chemical equilibrium. The course began 
by presenting the fundamental knowledge and approaches needed to 
solve chemical problems. Information was given on measurement, 
scientific notation, and classification as well as a systematic 
approach to problem solving that emphasized problem decomposition 
and pattern recognition. The structure and properties of solids, 
gases, and liquids then were introduced. Subsequent lessons 
were built on this foundation and described the behavior of matter 
in terms of energy anil disorder, reaction rates and chemical 
equilibrium, acic'-base behavior, oxidation-reduction, and 
electrical reactions. 

Systems cjntent. The teacher intended to use systems thinking 
to teach students about social and environmental problems related 
to chemistry. Problems were selected that had a chemical basis and 
were relevant to the students. 

During the fall, chemistry students were introduced to basic 
terminology and concepts in systems thinking. The relationships 
among rates, time, and levels were illustrated through construction 
of formulas and graphing. Students were given verbal problems or 
data sets and were instructed in graphing data, deriving rates and 
levels, and interpreting graphical trends. These concepts then 
were applied to the construction of both causal diagrams and simple 
structural models. After introducing examples from everyday life, 
such as the rate at which cars enter and leave a parking lot ovf?*- 
the course of the day, chemistry-related problems were modeled. 
These models included the development of smog and tooth decay. 

According to the teacher, initially students were moderately 
interested in the problems and model building. The level of 
interest increased later in the year when STELLA was introduced and 
instruction focused on more traditional topics (reaction rates), 
thus enabling students to see the relevance and applications of the 
approach to content-related problems. 

In addition to the problems of time mentioned by the other 
system teachers, selection of relevant, understandable examples was 
particularly difficult in chemistry. The teacher indicated that 
modeling a chemical system involved a high degree of complexity and 
knowledge that often was beyond the level of students' 
understanding. Even an apparently simple model of tooth decay 
became difficult due to the number of elements and the nature of 
the chemical reactions involved. Therefore, it was not easy to 
develop examples that were accurate, yet appropriate for students' 
level of knowledge. 

An additional concern was the integration of systems thinking 
into the regular curriculum. While discussion of socially relevant 
topics was interesting for students, it did not relate directly to 
the core curriculum. Therefore, during the second part of the 
O IS 
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yearv the teacher decided that the most appropriate application for 
systems thinking appeared to be in the instruction of reaction 
rateSf a traditional topic for all chemistry classes. 

Students were introduced to STELLA with the "cooling soup" 
lesson used in the biology classes. They recorded and graphed the 
data for the cooling rates of two liquids with differing initial 
temperatures? and were instructed to note differences in the slopes 
of the two liquids and conclude which liquid had the faster cooling 
rate. Students also were asked to note changes in slope and 
hypothesize reasons for the changes. Initially a causal loop 
diagram was developed to depict the relationship between 
temperature and rate of cooling. A structural diagram then ';as 
developed to test the model and determine if the expected behavior 
would result. The teacher used STELLA to demonstrate the behavior 
of the model and showed students how the model could be changed to 
reflect different conditions and thus different hypotheses. A 
population model was another example used to familiarize students 
with STELLA and structural thinking. 

In studying reaction rates? students were guided to develop 
systems^ models for chemical equations. Creating structural 
diagrams on STELLA provided an instructional tool not only to 
illustrate the function and relationship of certain variables to 
each other? but *o hypothesize and then test changes in the 
behavior of these variables over time? under different conditions. 
From these experiences? a generic understanding of the behavior of 
a set of interacting variables could be developed. 

As in the other science classes? models were used in 
conjunction with laboratory activities in a variety of ways. 
Sometimes models were created prior to experiments to introduce 
important elements in particular chemical reactions and predict how 
these elements might affect each oth<fr. At other times? models 
were created during or following experiments to illustrace the 
behavior observed? simulate other conditions? and comment on 
predictions. 



Data Analyses and Quantitative Report 

Due to the vast amount of data generated from the STACI 
Project's activities? the first year report has been separated into 
two parts: the present document which provides a general 
description of the site? curricula? and procedures? and the 
forthcoming document in which all data analyses will be reported. 

The student cognitive test data currently are being prepared 
for analysis. The analyses will focus on the preliminary results 
of students' performance on content tests and the systems thinking 
instrument. We will examine ability differences? as defined by 
performance on the reference battery and standardized tests. Most 
importantly? we will compare performance differences between the 
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systems thinking and traditional groups on the various measures^ 
particularly the specific content areas which were taught as 
systems models. The analyses will be conducted and reported during 
the fall, 1987. 

Dissemination of Project Information 

During the first year of the STACI Project, several 
manuscripts were prepared for publication or presentation at 
professiona} meetings: 

Mandinach, E. B. (1986). Innovative uses of technology to foster 
cognitive skills development in a high school science program: 
Research and design issues . City University of New York, 
Graduate Center. 

Mandinachf E. B. (1987). Computer learning environments and the 
study of individual differences in self-regulation . Paper 
presented at the annual meeting of the American Educational 
Research Association, Washington, D.C. 

Mandinach, E. B. (1987). Integrating systems thinking into the 
high school curriculum; The STACI Project . Paper presented 
at the National Educational Computing Conference, Philadelphia, 



Mandinach, E. B. (1987). The STACI Project; The second progress 
report (STACI Rep. No. 11). Princeton, NJ: Educational 
Testing Service. 

Mandinach, E. B. (1987). The use of simulations in learning and 
transfer of higher-order cognitive skills . Paper presented at 
the annual meeting of the American Educational Research 
Association, Washington, D.C. 

Mandinach, E. B., Si Thorpe, M. E. (1987). Systems thinking and 
curriculum innovation: A progress report (STACI Rep. No. 2). 
Princeton, NJ; Educational Testing Service. 

Mandinach, E. B., i Thorpe, M. E. (1987). The systems thinking 
and curriculum innovation project. Technology and Learning , 
Ua), 1, 10-11. 

Mandinach, E. B., & Thorpe, M. E. Caveats and realities in 

technological curriculum innovation. Technology and Learning , 
H'f), 1-3, 5, 7. 

An additional activity related to the project was a seminar 
given at the Apple Computer Company at tfte request of Dr. Barbara 
Bowen, Director of the Apple External Research Program, on May IS. 
Bowen asked ETS to make a presentation to Bay Area educators, 
representatives from state and county education offices, and Apple 
employees to describe the STACI Project and perhaps stimulate 
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interest in STAC I , systems thinking, and STELLA. ETS organized the 
presentation which also included a teacher and student from BUHS. 

Potential Caveats 

In general, the STACI Project has progressed smoothly with few 
evident problems. However, some of the implementation problems 
have been outlined in an article (Mandinach & Thorpe, 1987a) that 
recently appeared in Technology and Learning (see Appendix D for 
details). As noted in the first progress report, curriculum 
development took longer than anticipated and thus influenced the 
conduct of the study. STACI 's first year was considered 
exploratory rather than a formal test of knowledge acquisition and 
transfer. In addition, data collection was slightly dela/ed due to 
the complexity of obtaining informed parental consent. These 
constraints limited the extent to which we were able to draw 
conclusions from the first year of data collection. 

On the positive side, teachers have made consi.-'erable progress 
in their development of the curricula and students generally have 
responded positively toward the instructional materials. Despite 
delays in curriculum development, the teachers were able to 
identify, design, and implement systems modules that were 
integrated into the existing courses. Ue have collected a wealth 
of valuable classroom data from which we will be able to make 
preliminary comments about the impact of the curriculum innovation 
on teaching and learning activities. Ue also collected important 
information from the War and Revolution seminar about the effects 
of the systems thinking approach on the process of knowledge 
acquisition. 

As the project begins its second year, we again will confront 
the problem of parental consent. Ue will attempt to obtain consent 
frn'n parents who previously withheld permission. Ue also must 
identify those students who are new to the project and seek consent 
from their parents. This activity will be undertaken as early as 
possible in the forthcoming academic year* 

Much effort will be focused on revisions of instrumentation, 
observations, and data collection procedures, as indicated by the 
first year's results. The system thinking instrument already has 
been revised. The formalization of data collection procedures will 
be critical. We have faced and again must confront the delicate 
balance between requesting certain pieces of information from the 
teachers and burdening them with too much documentation. As noted 
above in the curriculum section, we are working toward identifying 
the specific data that will best inform us about curriculum 
procedures and content. Such documentation must be made highly 
explicit in order for the teachers to be able and willing to 
comply. These data collection procedures are essential because of 
ETS's distance from BUHS, which limits the amount of time staff can 
spend on site. It is virtually impossible to document all uses of 
and outcomes of the curriculum innovation simply because we cannot 
be in Brattieboro all the time. Thus, ETS must rely on other 
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documentation procedures that will be used in our absence. \Ae do 
bslieve^ however^ that several week-long observations^ in 
conjunction with the procedures noted above^ should provide 
sufficient data from which to examine the impact of systems 
thinking. 
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Footnote 

This research is being conducted under the auspices of the 
Educational Tec^-.nology Center, Harvard Graduate School of Education 
and is supportsd by the Office of Educational Research and 
Improvement under contract number ^00-83-00^1. Any opinions, 
findings, and conclusions or recommendations expressed in this 
document are those of the authors and do not necessarily reflect 
the views of ETC, OERI, or ETS. The authors wish to acknowledge 
Tony Cline and Nancy Benton of ETS, Dr. Barbara Bowen of Apple 
Computer Company, Charles Butterfield, David Clarkson, Chris 
O'Brien, Larry Richardson, and the administration and students of 
Brattleboro Union High School. 
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TEACHEK QUESTIONNAIRE 



TOPICS 



What science concepts/knowledge have you tried to teach using 
systems thinking? 

Are these topics also being taught in the traditional classes? 
INSTRUCTIONAL METHOD 

How have you introduced these topics? 
Prerequisi te knowledge 
sequence 
logic 

Examp les/ i 1 lustrations used- 
How would you have introduced these topics if you had taught them 
in the traditional manner? 

STUDENT ASSIGNMENTS/ACTIVITIES (Paper/Pencil/ STELLA) 

What have the students been required to do with systems thinking 
beyond class discussion? 

Describe inclass activities & assignments 

LESSON ASSESSMENT: (BEHAVIORAL/ANECDOTAL EVIDENCE) 
How receptive were the students to these lessons? 

What were the strengths of tht lesson? 

What? if anything? did not work as well? 

What would you do differently next time you wanted to teach these 
concepts? 
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INTEGRATION 



How satisfied are you at this point with integration of systems 
thinking which you have attempted? 

Is the systems perspective influencing your teaching even when 
you are not discussing the behavior of systems? If so howj give 
examples. 



NEXT STEPS 

What needs to be done next? 

Are there any particular problems/pressures that are inhibiting 
curriculum development or conducting lessons? 

What type of assistance do you need? 
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War and Revolution Project 
The Zimbardo Prison Experiment 
May, 1987 



You have learned a great deal about a number of revolutions and 
have translated that understanding into complex systems models. 
You're now going to be asked to use your knowledge of revolutions! 
systems thinkingv and STELLA in a new problem. 

This problem is the Zimbardo Prison Experiment) that was conducted 
at Stanford University in I*??!. Dr. Zimbardo, a social 
psychologist) conducted an experiment to examine what would happen 
when college students were placed in a mock prison situation* In 
effect) Zimbardo constructed his own simulation. 

Your task will be to try to create a systems model of the 
experiment. You are being given an article from the New York Times 
haoazine that describes the events surrounding the experiment. 
This article should provide valuable background information. 
Please read it carefully before class on May 22. On May 22) we 
will show a slide-sound presentation^ then conduct a class 
discussion about the experiment. On Monday) May 25) David Kreutrer 
will join us to help facilitate discussion about the study and the 
models you are to build. The rest of the week will be devoted to 
building your models. 

By Thursday^ we hope that you will have some well -developed models. 
Don't worry about the final product because we know that the 
experiment is complex and contains many variables. All we ask is 
that you try to develop your models as thoroughly a«= possible. 



Some Ground Rules 

Use the New York Times article as a basic reference. 
You can go back to the slide-sound presentation? if necessary. 
(We also will provide scripts of its narration for your 
reference. ) 

Use Mr. Clarkson) David Kreutzer, other students) and ETS c»s 
available sources of information. 

Collaboration is fine. However* we would like to get final 
reports from each of you. That means you can woi k together as 
much as you would like, but each of you must submit your report 
and model separately. 

You will be given disks and a notebook. We ask that you save 
a copy of each model you contruct toward the final one. We 
also would like to see any notes or other aids you use m 
constructing your model. 

We really want to understand the process you use to develop your 
model. In the end) we will ask you some questions about how 
you worked toward a solution, your thoughts about the model) 
and the similarities and differences between this project and 
your revolution model. 
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At the end of the week, we will collect the work you have done. 
That does not mean you have to stop work on the model. Feel 
free to devote more time to the project. There is always lots 
more you can discover about the systems within the experiment. 

After you have handed in you model, we will provide some 
additional background information and show a model of the 
eKperiment constructed at MIT. 

Good luck and have fun. We hope that this project wall be 
challenging, interesting, and a chance use some of the ideas you 
have learned in the War and Revolution class. 
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Tbe New York Times Maguine/April 8. 1973 

Contents 



II Lmnw 

MBcr»l»«ndSCaUii» 



33 



II coimterliadg^l for fodcd progrMs 

•yAttetM.JUvtoi 

34 



9*yMfaMwai« Ota •IBI»r 

Tho gum bmiaMS 
36 



Tliore «n wcnrto lb«M« too 




38 



A PfraadolUoB prison 



OmtoKt;«lMrv« 



Tour novo, Xisdagor 

9yJmnm C mmmay 



74 WMtm's 


M«o'ir«Uoaf 


TmMmwm 


fVml-naifiiiv 








lyJMiiCniipoM 




112 BrUfO 


73 rood _ 


GiMpif thtiay 


X juhvImI Iftlcf? 




Viilellyoirtfiil 




l07PUtwoe^i41tt 




IMPwlM 


■1 rood (mot) 












W M tett«r. rich to 




chotoitofl • . • Md 
fiK ms^ mmny imtrl* 
Itofiitti. fii«t 72. 


•0 Bmio 


lithtrtfiiftopt/of 


Vmkmmbmm 
if rftgom 


foyrmtir Sm P»f« 


ftfNiniMMt 





tbt activity antf oaovinatiM luarit and piia. 
.anm. 71m ptoytkai anviipamcnt wu mm in which 
riMMfi mM alwayc bt •kaarvai tiM cult 
aniy asfitption Mag whm thty vtit MdtiM 
In coUuiy cMi lUM matt (a imII, dark iUnft 
doact. labaM -Hm IMa^ 

Oiir MCk pfffcM rapra«Bta< aa afianpi w tf» 
alata Um p^fcholegieal cuia al taiprfacnaMM ia 
aaruia wayi. Wa baaatf aur axpavioMal aa aa to- 
<apth aaaJyiJa af tba priioa cituatta» tfavalopatf 
•ftar hMi4fadi aT houit al diicuama whh tela 
fnacotJL (y 8s«caa caasultam), paipla affican 



aaich af ttoa aaUttef UtantHia aa pfteaaa aad m. 



"XaaT yrtaanafa typically nport faaUng „i,w«. 
Iaaa» arWtrarily caatfoUad. dapMdaat. IfWimta^ 
kopalau. anaaymaiM* dahamaaiiad ud laiaara 
latad. Uwaa aoc pactiMa^^KiaatMlyarathicaUy. 
la craata aueh chnaic lUtaa la valuacav aibjactr 
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SCIENCE CURRICULDM: BIOLOGY 



%TINE %TOPIC 

CHAPTER TOPIC PER TOPIC V/SYSTENS TEACHER 



+1 Life: Common Characteristics 4 G 

3 C 

4 20 R* 

2 Biology as a Science 9 G 

3 C 

3 R 

3 Materials of Life 6 G 

3 C 

5 R 

4 Energy of Life 6 G 

9 C 

8 R 

+5 Cell Structure & Function 17 G 

12 C 

16 16 R 

-f-6 Cellular Basis of Heredity 7 G 

6 C 
12 29 R 

7 Principles of Heredity 8 G 

9 C 
8 R 



+ Systems Integrated Here 

%TIM£ PER TOPIC: Reflects the percentage of time devoted to each topic 
during 1986*87 school year. Percentage of time 
derived from the number of days per topic divided by 
total number of instructional days per year. 

%TOPIC W/SYSTEMS: Reflects percentage of time a particular topic was 
taught from a systems perspective. Percentage of 
topic with systems derived from an estimate of the 
number of days devoted to instzruction with systems 
divided by the number of days per topic. 

TEACHERS: Godfrey (G) 
Coles (C) 
^Richardson (R) Systems Teacher 
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SCIENCE CURRICUUM: BIOLOGY 



%TINE %TOPIC 

CHAFjTER TOPIC PER TOPIC W/SYSTENS TEACHER 



8 


Gen6S and Chromosomes 


11 


G 






9 


C 






24 


R 


9 


The Genetic Cv^de 


7 


G 






9 


C 






7 


R 


10 


Change With Time 




G 






5 


C 






*" 


R 


11 


Adaptation & Specialization 




G 






5 


C 






2 


R 


12 


Classification 




G 






3 


C 






• 


R 


13 


Monerans , Protists , Fungi 


3 


G 








C 






• 


R 


14 


Plan • 


2 


G 








c 








R 


15 


Sponges to hollusks 


1 


G 








C 








R 


16 


Arthropods to Vertebrates 


2 


G 








C 








R 


17 


Simple Organisms 


1 


G 






3 


C 








R 


19 


Simple Organisms 


4 


G 




and Disease 


6 


C 








R 
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SCIENCE CURRICUUM: BIOLOGY 



tTIME tTOPIC 

CHAPTER TOPIC PER TOPIC V/SYSTEMS TEACHER 



2'J Plant Reproduction 8 G 

and Development 6 C 

R 

+21 Plant Nutrition 8 G 

3 C 
12 SO R 

22 Plants: Other Life Functions - G 

3 C 

R 

24 Animal Development • G 

3 C 



R 



+ Systems Integrated Here 
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SCIENCE CURRICUUUM: CHEMISTRY 



%TIME %TOPIC 

CHAPTER TOPIC PER TOPIC V/SYSTEK^ TEACHER 



1 Nature, Science & You - B* 

1 G 

2 Measuring & Calculating 4 B 

6 6 

3 Matter - B 

2 G 

4 Chemical Shorthand 12 B 

8 G 

5 The Mole 8 B 

8 G 

6 Atomic Structure 12 B 

8 G 

7 Electrons & Clouds 8 B 

6 G 

8 The Periodic Table 4 B 

7 G 

9 Process of Bonding 4 B 

6 G 

10 Results of Bonding 2 B 

1 G 

11 Structure/Properties 1 B 

of Molecules - G 

12 Kinetic Energy 4 B 

2 G 

14 Liquids 2 B 

8 G 



TEACHERS: Groves (G) 

^Butterfleld (B) Systems Teacher 
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SCIENCE CURRICUUDN: CHEMISTRY 



CHAPTER 



Toric 



tTIME tTOPIC 
PER TOPIC V/SYSTEMS TEACHER 



15 



16 



18 



+19 



20 



21 



23 



+s 



Gases 



Gases and the Mole 



Solutions 



Reaction Rate & Chemical 
Equations 



Nuclear Chemistry 



Environmental/ 
Social Problems 
(Ecosystems, Mineral 
Depletion, Smog, Tooth 
Decay, Water Pollution) 



6 
5 

7 
5 

2 
8 

12 
6 



Acids, Bases, & Equilibrium 8 

3 

Oxldation-Leductlon 4 



10 
9 



100 



100 



B 

G 

B 

G 

B 

G 

B 

G 

B 

G 

B 

G 

B 

G 

B 

G 



•t- Systems Integrated Here 
s Supplementary Topics 
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SCIENCE CURRICDUIM: G.P.S. 



%TINE %TOPIC 

CHAPTER TOPir PER TOPIC V/S^STENS TEACHER 



+1 The Nature of Science 6 J 

9 7 0* 

2 Force and Work 12 J 

2 0 

+3 Motion - J 

9 13 0 

+4 Laws of Motion - J 

1 0 

+5 Properties of Matter 8 J 

9 7 0 

6 Elements & Periodic Table 17 J 

9 0 

+7 Compounds and Bonding 23 J 

9 27 0 

8 Families of Elements: Metals - J 

2 0 

9 Nonmetals - J 

1 0 

10 Families of Elements: Carbon - J 

1 0 

11 Organic Chemistry - J 

1 0 

12 Solutions - J 

1 0 

13 Chemical Reactions 11 J 

3 0 



+ Systems Integrated Here 

TEACHE^.S: Jessup (J) 

^O'Brien (0) Systems Teacher 
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SCIENCE CURRICULDN: G.P.S. 



%TIME %TOPIC 

CHAPTER TOPIC PER TOPIC V/SYSTEMS TEACHER 



+15 Waves - J 

9 13 0 

+16 Light and Color - J 

3 40 0 

17 Light and its Uses - J 

3 0 

18 Sound - J 

1 0 

19 Heat - J 

1 0 

+?1 Electricity - J 

11 20 0 

+22 Electricity & its Uses - J 

11 5 0 

s Scientific Notation 10 J 

s Nuclear Power 14 J 
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Caveats and Realities in Technological 
Curriculun: innovation^ 



Ellen B. Mandinach and 
Margaret E. Thorpe' 
Educational Testing Service 
Princeton, NJ0B541 

In a previous article (Mandinach & 
Thorpe, 19B7), we described an 
innovative curriculum project that 
integrates a perspective known as 
systems thinking into high school 
science and social studies. Using 
software called STELLA (Richmond, 
1985) on the Apple Macmtosh^^, 
students can build rmdels and 
simulate the operation of those 
models over time. The user can test 
the effects of changes on selected 
variables or the system as a whole 
by altering characteristics of par- 
ticular variables within the model. 

The curriculum project, Systems 
Thinking and Curnculum lnrK>vation 
(STACI), IS a collaborative effort of 
four teachers at Brattleboro Union 
High School (BUHS) in Vermont and 
the Educational Testing Service, in 
cooperation with the Educational 
Technology Center at Harvard The 
BUHS teachers are the curriculum 
developers and implementers m 
general physical science, biotpgy, 
chemistry, and an experimental 
course entitled War and Revolution. 
With the support of several indi- 
viduals within their community, as 
well as experts from MIT and Dart- 
mouth, these teachers have assumed 
responsibility for integrating systems 
thinking into their curricula. The role 
of ETS is to examine the cognitive 
demands and consequent jes of using 
systems thinking and the modeling 
software. Of primary interest is the 
extent to which students acquire 
higher-order cognitive skills through 
interaction with a curnculum infused 
with systems thinking concepts and, 
subsequently, generalize knowledge 
and skills to other substantive areas. 



.The intent of this aaicle is to 
discuss issues related to the develop- 
ment and implementation of a 
technology*oriented curriculum inno- 
vation from the perspective of practi- 
tioners and researchers. Each 
perspective has its own responsibi- 
lities, objecti>^, and interests, yet 
there is comnron interest and 
reliance among the involved paaies. 
We begin the discussion from the 
perspective of the practitioners, 
whose responsibility for the cur- 
riculum development and implemen- 
tation underlies the innovation. We 
then describe the reseafch perspec- 
tive and issues that arise between 
research ana practice in the ettort to 
study curriculum innovation. 

PractitlonBr PerspectivB 

There are several issues related to 
curriculum development and tmpie- 
rDentation that arise from the practi- 
tioner's perspective - administrative 
support, physical resources, person- 
nel considerations (e.g., release time, 
expeaise, and support from col- 
leagues), instructional concerns, and 
dissemination. 

Administrative Support 

A prerequisite for curriculum inno- 
vation IS suppoa from the adminis- 
tration. This support can take various 
forms and lends credibility to the 
project. Its absence can seriously 
undermine even the most educa- 
tionally sound effort. For example, 
the pnncipal at BUHS thoroughly 
supports the STACI project and has 
chosen to place responsibility for 
decision making and overall opera- 
tion in the teachers' hands. He tends 
assistance, if necessary, but prefers 
to allow the teachers to administer 
their own project. 
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Mandinach and Thorpe (cont'd) 
Physicai Resources 

A second issue is the provision of 
facilities, materials, and equipment 
— the resources that are necessary if 
implementation is to succeed. 
Because curriculum innovations that 
focus on new technologies are costly 
endeavors, they often are beyond the 
means of most school systems. 
Thus, assistance to obtain hardware 
and software facilitates tiniely and 
effective impiennentation. 

Recognizing the difficulties of 
meeting thar needs, the teachers 
sought assistance from internal and 
external sources. For initial develop- 
ment, they obtained a federal grant 
through wh:jh software and one 
Macintosh^^ were purchased. Apple 
External Research generously 
donated a classroom set of 15 com- 
puters. In addition, BUHS was able 
to acquire 15 copies of STELLA and 
a portable projection system with 
help from ETS. Through the 
assistance of the principal, the 
teachers were able to secure a room 
which now housss the computer 
laboratory. Without these resources, 
the systems thinking project could 
have functioned, but at a substan- 
tially diminished levcf. 

Personnel Cons/deratfons 

A number of personnel issues 
confront practitioners involved in cur* 
riculum deveiopPDent and implemen- 
tation ArT>ong the most pressing 
issues are release time, expertise, and 
support from colleagues. 

Release time. Curriculum develop- 
ment IS a ttrne consuming and 
demanding process under normal 
Circumstances. It is rTX}rb difficult 
when there are no models to follow 
Because curnculum guides do not 
exist, the BUHS teachers have 
created their own curricula. Develop- 
ment required a considerable outlay 
of time to read, reflect, experiment, 
and refine ideas and lessons. Though 
the teachers began some preliminary 
work in the spring and suma\er of 
1966, the major development effort 
occurred during the following 
academic year. As a consequence, 
the issue of release tinrie for develop* 
ment was a primary concern. To free 
the teachers for development acti- 
vities during the school day, 
paraprofessional support was obtain- 
ed to assume some of their non- 
teaching functions. Although this 
strategy has allocated intervals of 



time for curriculum development, the 
competing dennands of busy teach- 
ing schedules inhibited sustained 
activity and prolonged developrrient. 

There are no easy solutions to this 
Situation. The teachers indicated that 
release time was essential to their 
development efforts. Before curricula 
could be developed for students, 
staff needed tinne to further their 
own knowledge of systems thinking 
and STELLA. Delays in developing 
expertise mitigated against the 
developrDent of materials prior to the 
beginning of school. 

Expertise. Curriculum development 
demands expertise in the domain of 
interest Although the BUHS 
teachers are expers in their subject 
areas, they had to develop expertise 
in systems thinking and the use of 
STELLA. This required substantial 
time to learn the concepts and 
experiment with the tools. 

The teachers independently pur- 
sued further training or assistance 
pertaining to their partk:ular needs. 
They attended a sumnier workshop 
on systems thinking and consulted 
experts m systerm thinking from 
MIT The developers of STELLA have 
consulted on appropriate uses of the 
software Intellectual support from 
these experts has been instrunDental 
in devetoping the teachers' level of 
knowledge and skill. 

The process of devetoping exper- 
tise in systems thinking has had 
unintended but beneficial effects, it 
has provided teachers with oppor- 
tunities to bring a fresh perspective 
to instruction by reflecting on cur- 
ricular goals and considenng how 
systems thinking can be used to 
demonstrate new ideas or to rein- 
force traditional concepts in new 
ways. It also has provided chances 
to broaden traditiorial instruction to 
include a problem solving approach 
that may be relevant to learning m 
other content areas. FurthernrK)re. in 
attempting to understand systems 
thinking, teachers have identified 
confusions similar to those 
experienced by students that can 
strengthen thar teaching of the cur- 
riculum. By anticipating possible 
problem areas, teachers may be able 
to adapt their instruction to clarify 
difficult concepts. 

Support from colleagues. While 
intellectually stimulating, curriculum 
developrDent can be an uncprtain 
and frustrating process. To complete 



the process, difficult questions must 
be answered and creative solutions 
'found. However, often the solutions 
are not readily apparent. While out* 
side assistance has been invaluable, 
there is a need for internal suppoa to 
deal with developrrient questions. 
The four BUHS teachers have form- 
ed a collaborative group providing 
encouragerrient and assistance to 
pursue individual and common 
interests. They exchange ideas and 
instructional strategies, and 
collaborate to develop and test 
models. 

Instruct/onal Concerns 

Central to curriculum devetoprr^ent 
and implementation effoas are issues 
related to instruction. These con- 
cerns include questions of integra- 
tion, instructional sequence, instruc* 
tional time and academic standards. 

Curriculum integration. The over- 
riding concern is to determine what 
topics are nnost appropriately taught 
with a systems perspective, the 
selection of which has not been 
easy. Teachers have spent con- 
siderable time investigating areas that 
might be appropriate for a systems 
approach, in selecting topics, two 
criteria were applied. First, examples 
must Illustrate a cause-and-effect 
relationship within a feedback struc- 
ture Second, examples must be 
within a student's level of under- 
standing The availability of topics 
that lend themselves to systems 
thinking has differed across subject 
areas. Biology, with numerous 
examples of living systems, appears 
most readily suited to a systems 
approach Finding appropnate 
examples that are not too complex 
has been most difficult in cliemistry 
(e.g., reaction rates). 

Instruct/onal time. Inherent in the 
development and implenr>entation of 
any innovation are unceaainties 
about demands that accompany the 
adoption of a new approach. 
Foremost is the issue of instructional 
tirT>e. The introduction of new 
material ts likely to decrease attention 
to traditional topics. In the present 
case, time was needed to teach 
systems terminology and concepts 
Thus, devoting tin^e to instruction m 
systems thinking meant reducing 
time devoted to traditional subjects. 

It was not known how tong 
students would need to learn 
systems concepts, become familiar 
with the microcomputer, and learn 



49 



ERIC 



Mandinach and Thorpe (comW 

STELLA. Further, it was not clear 
when these concepts should be 
taught and if students would transfer 
krK>wledge across lessons or 
courses. From thar experience this 
year the teachers gained a better 
idea of learning tinne and the points 
where systenns can most effectively 
be used in the curricula. As a result, 
nfH>re efficient use of instructional 
time will be possible in the coming 
years. Moreover, as students are 
exposr J to systems thinking, less 
time will be needed to teach basic 
systems concepts, allowing them to 
focus on applications in the content 
aieas. 

instructional sequence. Determin- 
ing appropriate sequences for 
instruction is also a major concern. 
Again, because of the absence of 
nr)odel courses, the BUMS teachers 
experimented with various sequences 
to best determine how to order the 
materials, i he teachers tried different 
patterns (eg., varying when models 
or STELLA are intnxjuced). Feed- 
back from these efforts provided 
information needed for revisions to 
be implemented m the coming years. 
K IS likely that several iterations will 
be necessary to determine the most 
effective instructional sequences. 
This means that the teachers will 
continue to tinker with their 
curricula. 

Achieverrwnt standards. The intro- 
duction of an innovation raises con- 
cern for its effect on academic stan- 
dards. Two types of standards may 
be imperiled if new instructional acti* 
vities are introduced: performance on 
standardized testn r^-iay be jeapordiz- 
ed; and curriculu'n objectives may 
not be realized. Thus, the goals of 
the innovation may be perceived to 
be in direct conflict with the pressure 
to PDaintam academic standards. A 
tradeoff underlies this apparent con- 
flict if the innovation is given a fair 
test. It is likely, however, that the 
innovaton will require additional at- 
tention at the expense of some tradi- 
tionally valued materials. 

Academic achievement is valued 
highly at BUHS, thus creating 
pressure to maintain standards. Tradi- 
tional cumculm objectives have been 
difficult to nnaintain due, in part, to 
tty» innovation. Alkx»ting time to 
n^w material not directly related to 
traditional objectives caused conflict 
for the systems teachers. Ccmmit- 
ment to the use of systems concepts 



and methodology shortened 
coverage of some traditional topics. 
In the k)ng run, evaluative informa- 
tion concerning the effects of 
systems thinking should provide 
evidence relative to the assessment 
of the innovation's worth. 

Dissemtnation 

Dissemination can range from 
formal presentations or publications 
to nnore informal, personal contacts. 
These >^icles serve different needs. 
At one level, dissemination can sen« 
an informational need, alerting others 
to the existence and nature of the 
inr)Ovation. At another, it can serve 
to solicit support or adoption by 
others. 

The BUHS teachers have engaged 
in a number of formal and informal 
activities to share information about 
systems thinking with other staff 
members in their school. The 
systems teachers presented their 
project to the staff and welcomed 
inquiries from interested teachers. To 
encourage further dissemination, a 
training session was offered to 
interested students, faculty, and 
community members. 

Research Perspective 

Several issues related to cur- 
riculum innovation arise from the 
research perspective These include 
balarKing the lesearch perspective 
from that used by the practitioner, 
obtaining student partiopation, 
design issues (e.g., units of analysis, 
treatment differences, the nature of 
the intervention), and burdens 
created by conducting the research. 

Balar)Cing Perspective 

The research perspective differs 
from that of the practitioner in a 
number of ways. Praaitioners 
devetop and implement the cur- 
riculum, whereas researchers study 
the process and effects of introduc- 
ing such innovations. These dif- 
ferences provide opportunities for 
collaboration as each perspective 
brings information valuable to the 
efforts of the other. Without practi* 
tioners, there would be no innovation 
to study. Without researchers, ihe 
consequences of innovatk)n may not 
be understood. 

While researchers and practitioners 
recognize the potential benefits of 
collaboration, the realities of conduc- 
ting research in school settings 
impose certain limitations arvd 



demands on both parties. To study 
school-based innovations, there must 
be a balance of the needs of both 
practitioners and researchers — a 
balance which is not always easy to 
maintain. Often research requires the 
cooperation and assistance of practi- 
tioners beyond their normal com- 
mitments. White researchers must be 
sensitive not to exceed reasonable 
requests, practitioners must 
recognize that to conduct valid 
studies, certain research require- 
nients must be met. 

Student Ranicipation 

If a formal study is to t>e con- 
ducted to examine the innovation's 
impact, informed parental consent is 
required to protect the rights non- 
participating and participating 
students. Efforts must be made to 
protect non-paaicipating students 
from r)egative consequences as a 
result of their non-paaicipation. At 
BUHS, approximately 15% of the 
students have chosen not to par- 
ticipate in the study. The non- 
consenting students received the 
curriculum innovation as a normal 
paa of their instruction, but their 
work was not exarr ned as a 
research activity. 

Design issues 

A second intervention issue is the 
compatability between the research 
design and realities of classrooms. 
Methodokxjy and design must be 
flexibte to conduct research m school 
settings. That is. researchers must 
nn^ke compromises that will enable 
the collection of informative data. 
ComnrYon problems that arise include 
attntion, transfers, course changes, 
and other issues that alter the nature 
and composition of the sample and 
treatment. 

Units ofanaiysis At BUHS, we 
are fortunate to have relatively 
equivalent treatnnent and control 
groups An equal number of classes 
m each subject are being taught as 
treatments and controls. However, 
the added confounding factor that 
there is only one systems teacher per 
subject makes it difficult to 
distinguish between teacher and 
treatment effects. In the ideal design 
there would be several teachers for 
each subject. However, because 
schools rarely correspond to research 
designs, we must account for the 
confounding factor through appro- 
priate statistical procedures 
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Treatment differences. Another 
potential confounding problem is if 
parts of the treatment become in- 
fused in the control classes. If 
assessment of an inrxsvation's impact 
IS to be made, there must be a 
measurable separation between treat* 
ment and control classes. Should 
teachers in the control classes adopt 
aspects of the inno\^tion, there is no 
way to examine treatment dif- 
ferences. While this confound is a 
compliment to the innovative 
teachers, it is a nightmare to the 
researchers. Although infusion of the 
innovation distinguishes treatment 
from control, the course content of 
the groups should be comparable 
Because achie^ment is a primary 
outcome, it IS cntical that both 
groups recave equivalent subject 
matter instruction. It would be other- 
wise impossible to assess the innova- 
tion's impact if course content were 
not held constant. 

Nature of interventkm. The nature 
of the intervention directly influences 
the design of research. Students 
must receive sufficient exposure to 
tnc new instructional materials if the 
innovation is to affect achievement 
and learning. Thus, teachers must 
develop and use suffictently nch ar)d 
numerous modules of the r^ cur- 
riculum for effects to be realized. 
There is always a danger th.it 
research will be conducted before 
the new instructional program can 
be fully implemented. It is difficult 
and unfair for researchers to assess 
an innovation's impact when there 
has not been a sufficient 
implementation. 

Research Burdens and Contributions 

Research bnngs to a school cer- 
tain impositions that rr^ interfere 
with instruction. The prime example 
IS data collection. Research often 
requires the administration of tests 
that teachers would not normally use 
and observations that can upset 
classroom procedures, lir achers may 
be asked to collect mforrrtstion, 
document procedures, and perform 
other activities.outside the range of 
normal duties. All of the requests 
place additional burdens and respon- 
sibility on the teachers because of 
the research project. 

With all of these inconveniences, 
there also are positive effects caused 
by the research. P^aps the most 
important asset is validity. Research^ 



can prcvide evidence that the cur- 
riculurr^ innovation has had positive 
outcomes in learning, teaching, and 
instruction. It provides validation that 
the teachers' efforts have been suc- 
cessful and that the innovation was 
woah doing. The researchers' 
presence also indicates the innova- 
tion's imponance, and that the 
results should be disseminated to 
others who might want to implement 
the curriculum. 

Moreover, research can provide 
evidence of generalizability as well as 
local validity The ultimate goals of 
an innovation are twofold. The cur* 
riculum must be effective for those 
who developed it ar>d, more impor- 
tant « the Curriculum can be imple- 
mented in other settir^gs, thus 
establishing its generalizability This is 
the ultiiTiate compliment for innova- 
tive educators who strive con- 
tinuously to improve thar teaching 
and develop more effective instruc- 
tional materials. 
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